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© An equalizer/decoder (Fig. 12) for a communication channel presenting impairments to error-free reception 
of transmitted symbols includes a modified Viterbi decoder (930) operating on samples of received signals in a 
plurality of equivalent subchannels (on 910). Estimates of each of the subchannels are updated using a locally 
best estimate (960) in the Viterbi trellis processing, thereby avoiding delay in updating channel estimates in a 
rapidly changing channel such as a digital cellular'communications channels. A leaky predictor channel updating 
technique also proves advantageous in an alternative embodiment. 
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Field of the Invention 

This invention relates to the mitigation of communication channel impairments, and more particularly to 
the equalization of digital communications channels. 

5 

Background off the Invention 

Transmission of digital information over communication channels has been extensively studied. See, for 
example, A. J. Viterbi and J. K. Omura, Principles of Digital Communications and Coding , McGraw-Hill, New 
io York, 1979. Among the many techniques developed to improve the speed and accuracy of digital 
communication have been those used for compensating for the distortion present in many such channels. 
An important set of such techniques are those for equalization of delay distortion and intersymbol 
interference. 

A variety of techniques have long been used in equalizing relatively constant communication channels 
75 and adapting to changes that occur in the transmission characteristics of transmission channels' due to 
changes in environmental and other circumstances. See, for example, J. 6. Proakis, Digital Communica- 
tions, McGraw-Hill, New York, 1989; and S.U.H. Qureshi, "Adaptive Equalization," Proceedings of the IEEE , 
VoT73, pp. 1349-1387, September, 1985. An important class of such techniques use non-linear equalizers 
such as- decision feedback equalizers with adaptation logic to track slow variations in a channel after an 
20 initial learning phase. In this mode, it is assumed that the output of a decoder is correct with high 
probability. Error signals based on these output signals are then used to update the coefficients of the 
equalizer. Decision feedback techniques are generally described, for example, in A. Duel-Hallen and C. 
Heegard, "Delayed Decision-Feedback Sequence Estimation," IEEE Transactions on Communications , Vol. 
COM-37, pp. 428-436, May, 1989. 
25 Recently, interim (non-final) decisions in delayed-decision (Viterbi-like) decoders have been used to 
adjust coefficients characterizing equalizers used in data communications. Such equalizers, including so- 
called blind equalizers using little or no training, are described in copending U.S. patent application Serial 
No. 07/542,458 filed June 22, 1990 by N. Seshadri which application is assigned to the assignee of the 
present invention. 

30 Many communication channels, including cellular telephone channels, exhibit rapid changes in transmis- 
sion characteristics, thereby causing great difficulty in adaptively equalizing such channels. Digital cellular 
systems are currently implemented in some countries, and a new proposal has been made for standards for 
a new digital cellular communication system in the United States. See, "Cellular System," Report IS-54, by 
the Electronic Industries Association (El A), December, 1989. In the sequel, this proposal^ will be referred to 

35 as the "IS-54 standard" and systems of the type described therein as the "IS-54 system." 

When equalizing a mobile (cellular) radio channel such as those employing IS-54 systems, fast 
adaptation is required, especially at high vehicle speeds. Such channels are typically characterized by 
Rayleigh fading, Doppler effects and delay spread. Prior art equalization techniques have been found 
lacking in mitigating the effects of such rapidly changing channel conditions. 

40 While the prior art adaptive Viterbi Algorithm uses the globally best estimates of the transmitted data to 
update the estimates of the channel impulse response, processing used to develop these estimates 
necessarily introduces considerable complexity and delay. In a rapidly changing channel environment, the 
channel estimates so obtained may no longer be sufficiently accurate for currently processed symbols. 

The present invention avoids the limitations of the prior art and provides a technical advance in 

45 permitting rapid adaptive equalization of digital cellular communication channels and other channels, 
including those exhibiting such fast-changing characteristics. 

Summary off the Invention 

so It proves convenient to group information symbols occurring at rate 1/T into sequences (e.g., having 
130 symbols per sequence) at a transmitter for transmission over a communication channel and subsequent 
equalization/decoding at a receiver. Modulation techniques are used to match the information sequences to 
the transmission channel; such modulation is removed at a receiver by. a demodulation technique 
appropriate to the type of modulation. The resulting baseband signal then represents the transmitted 

55* -sequence, albeit in distorted form due to the effects of the channel and other processing. 

In part because fading cellular communication channels exhibit spectral nulls, illustrative embodiments 
of the present invention advantageously employ decision-directed techniques in providing channel equaliza- 
tion. More particularly, illustrative embodiments of the present invention use a modified trellis structure 
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related to that used in the well-known Viterbi decoding algorithm to perform decoding and equalization 
operations. 

In anticipation of equalization and decoding, however, the received baseband signal is, in accordance 
with an aspect of the present invention, advantageously sampled at a rate equal to a multiple, R, of the 
5 transmitted symbol repetition rate, 1/T\ The resulting -sampled sequence is then decimated in time to 
produce R subsequences, each having a sample rate of 1/T. The first subsequence includes samples 1, 
R + 1, 2R + 1, ... from the original sampled sequence; the second sequence includes samples 2, R + 2, 
2R + 2, ... from the original sampled sequence, and so forth. 

In accordance with an aspect of the present invention, each of the R sampled sequences is 
io advantageously compared with a locally generated signal representing the result of the passage of a current 
symbol and a predetermined number of past symbols through corresponding subchannels, each having 
respective estimated channel characteristics. Interim and final decisions about the symbols and the 
sequence actually transmitted are then made based on combined error values derived from the compari- 
sons. 

75 Another aspect of the present invention mitigates the effect of rapidly changing channel characteristics. 
In typical embodiment, the present invention advantageously employs a channel impulse response tracking 
algorithm using a "zero-delay" update algorithm based on more than one locally best estimate and typically 
as many as the number of states of the transmitted data sequence. Each local estimate typically comprises 
R subchannel estimates for use with the modified Viterbi algorithm. The zero-delay updating is based on 

20 these locally best estimates of the data sequence for each symbol interval. 

Also useful in alternative embodiments of the present invention is a so-called leaky channel predictor for 
estimating channel characteristics that enhances error performance, especially at high vehicle speeds 
illustrative in a cellular system. 

These and other aspects of the present invention are further illustrated in a space diversity receiving 

25 station in a mobile communication system. Using a plurality of receiver antennas, the station advanta- 
geously uses the subchannel and zero-delay updating techniques summarized above to achieve improved 
reception, even for rapid, deep fading signals. 

Brief Description of the Drawings 

30 - . 

These and other aspects of the present invention will be described in the detailed description presented 
below in connection with the included drawing wherein: 

FIG. 1 is a block diagram representation of a communication system employing the present invention. 
FIG. 2 shows slot formats for typical mobile to base station and base station to mobile unit communica- 
35 tion in a digital cellular communication system 

FIG. 3 shows phase assignments for symbols in a DQPSK modulation arrangement for use in a 
communication system. 

FIG. 4 shows a differential encoder that may be used in conjunction with the present invention. 
FIG. 5 shows a typical modulator for use with the present invention. 
40 FIG. 6 shows a two-ray channel model for use with the present invention. 

FIG. 7 shows the overall combination of receive and transmit filters with the channel exhibiting additive 
noise. 

FIG. 8 shows a representation of a circuit for generating subsequences corresponding to the sampled 
demodulated signal received from the channel prior to decoding. 
45 FIG. 9 shows the data sequence being processed through corresponding subchannels of the overall 
channel shown in FIG. 7 to generate noiseless channel subsequences. 

FIG. 10 shows a particularization of the arrangement of FIG. 9 for the typical case of two subchannels, 
each of which is illustratively characterized by three estimated channel coefficients. 
FIG. 11 shows a trellis diagram illustrating state changes for a communication system using a four- 
50 symbol constellation in each symbol interval and employing a channel with a two-symbol memory. 

FIG. 12 is a functional diagram of an equalizer/decoder in accordance with an aspect of the present 
invention. 

FIG. 13 is a block diagram of an arrangement for calculating branch metrics in accordance with an 
aspect of the present invention. 
55 FIG. 14 shows a reduced-state trellis for use, in accordance with one aspect of the present invention, 
with a rapidly changing channel. 

FIG. 15 is an example of a trellis of the type shown in FIG. 14, showing paths through the trellis used in 
calculating a minimum metric. 

3 
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Detailed Description 

To avoid unnecessary repetition of background and context information, co-pending U.S. patent 
applications Serial No. 07/395,930 filed on August 18, 1989 and application Serial No. 07/542,458 filed on 
5 June 22, 1990 are hereby incorporated by reference in the present disclosure. Additional background 
material relating to cellular communications systems will be found in the above-referenced EIA IS-54 
standard document. 

While the present disclosure will proceed largely in terms of algorithms and processes, as will be best 
understood by those skilled in the art, it proves convenient to implement such processes and algorithms, in 
70 typical embodiments, in mobile and base station systems using special or general purpose processors 
under the control of stored programs. Typical of general purpose processors useful in implementing the 
teachings of the present invention is the AT&T DSP-16 family of digital signal processors. 

Particular aspects of the functionability to be described below may also be implemented using standard 
special purpose digital circuits such as memory, comparators, analog-to-digital and digital-to-analog con- 
75 V erters. The system described in the IS-54 document will be used as a typical application context for the 
present invention. 

Overall Communication System 

20 FIG. 1 shows an overall block diagram representation of a system employing the present invention. 
Shown there is an information source 10, which in the case of the IS-54 system might be a voice or data 
source. Typically, a voice input will be sampled in source 10 to produce a data sequence of binary or other 
digitally coded signals. Other standard processing, including matching of source sequence signals to 
channel 30 are represented by coder/modulator 20. Channel 30 is illustratively a multipath, fading channel 
25 encountered in digital cellular communication systems. 

As will be described in more detail below, signals received from channel 30 are processed first by 
those receiver elements which produce sampled information represented by demodulator block 40 in FIG. 
1. Equalizer/decoder 50 further processes the received demodulated sampled information to form estimates 
of the symbols actually transmitted into channel 30. Equalizer/decoder 50 will be described in greater detail 
30 below. Finally, the symbol estimates are provided to an information using element 60, which illustratively 
includes digital to analog conversion processing when the original source signals are analog voice signals. 

The system of FIG. 1 advantageously groups information to be transmitted into channel frames such as 
200 in FIG. 2. There, the channel frame format of the IS-54 standard is shown, with 6 time slots in each 
channel frame. In accordance with the IS-54 standard, each frame has a duration of 40 milliseconds (msec), 
35 with 972 differential quadrature phase shift keying (QPSK) signals transmitted in each such frame. 

Each input speech signal communication in the illustrative system occupies two of the six time slots (1 
and 4, 2 and 5 or 3 and 6). The speech coder included in coder/modulator 20 in FIG. 1 is advantageously a 
block encoder which digitizes speech occurring over consecutive 20 msec input periods and, after 
generating and adding error control bits, typically yields a total of 260 bits to represent the speech over 
40 each 20 msec input interval. These 260 bits are then transmitted over channel .30 in FIG. 1 in one of the 
time slots, such as time slot 3 in frame 200 in FIG. 2. 

Each of these time division multiplex slots has a duration of 6.66 msec and, for the case of a mobile- 
station-to-base-station communication, includes the fields shown in greater detail in 210 in FIG. 2. A 
. somewhat different pattern of symbols is used in the case of a base-station-to-mobile-station communica- 
45 tion, as shown by the expanded time slot 220 in FIG. 2. These symbol fields include information used for 
synchronization, training and control. More particularly, the field labels shown in time slots 210 and 220 
have the following meaning: 
G - Guard Time 

R - Ramp Time 

so SACCH - Slow Associated Control Channel 
SYNC - Synchronization and Training Word 
DATA - User Information or FACCH. 
CDVCC - Coded Digital Verification Color Code 
RSVD - Reserved 

55 
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Digital Modulation Scheme 

The digital modulation method chosen for the U.S. digital cellular system IS-54 system is a modified 
version of differential four phase shift keying scheme with differentially coherent detection, known as J 

5 shifted DQPSK or J -DQPSK (W4-4DPSK) for short. Every second symbol is rotated by J radians. Another 
way of expressing this is that from an eight-phase PSK (8PSK) signal point constellation, a 4PSK 
constellation (denoted •) is selected for one during even symbol times and the remaining 4PSK constella- 
tion (rotated J ) (denoted ■) is selected for use during odd symbol times as illustrated in FIG. 3. This results 
in a somewhat more constant envelope, especially by avoiding signal transitions through the origin. The 

70 illustrative modulation scheme uses the Gray coded phase constellation as shown in Table 1. Since the 
most probable errors due to noise result in the erroneous selection of an adjacent phase, most symbol 
errors contain only a single bit error. The information is advantageously differentially encoded. Thus the 
symbols are transmitted as changes in phase rather than absolute phases. A block diagram showing the 
use of the differential encoder is shown in FIG. 4. 

75 The binary data stream, B k , entering the modulator is converted by a serial-to-parallel converter 410 into 
two separate binary streams (X k ) and (Y k ). Starting with the first bit, bit 1, of stream B kl all odd numbered 
bits form stream X k and all even numbered bits form stream Y k . The digital data sequences (X0 and (Y k ) 
are encoded by differential phase coder 420 onto (l k ) and (Q k ) according to 

20 l k = l k -i cos[A$ k (X k , YO] - Qk-i sin[A* k (XK, Y k )] ' - ' 

QQk = lk-i sin[A* k (X k , Yk)] + Qk-i cos[A<J> k (Xk, Y k )] (1) 

where Q k -! are the amplitudes at the previous pulse time. The phase change A<£ k is determined 
according to the following Gray code table 

25 
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40 
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45 




Table 1. 





The signals l k , Qk at the output of the differential phase encoding block can take the values 0, ±1 , 

50 

55 resulting in the 8 point constellation shown in FIG. 3. Impulses l k , Q k are applied to the inputs of I & Q base- 
band filters 510 and 520 shown in FIG. 5. The base-band filters used in the illustrative system typically have 
linear phase and square root raised cosine frequency response with a roll-off factor of 0.35, as is described 
more completely in the IS-54 document. 
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FIG. 5 shows a typical implementation of the modulator included in coder/modulator 20 in FIG. 1. After 
filtering by filters 510 and 520, the inputs are applied through multipliers 530 and 560 to signal source 540 
and phase shifter 550 before being combined in summer 570 to produce s(t). The resultant transmitted 
signal s(t) is given by 5 



10 



75 



25 



s(0 = £ g(t-nT) cosO n cosco c t - 2 g(t~ nT ) sin °n sinco c t 



(2) 



where g(t) is the pulse shaping function, *> c is the radian carrier frequency, T is the symbol period, and $ n is 
the absolute phase corresponding to symbol interval number n. The 4> n which results from the differential 
encoding is: 4> n = * n -i + A*n- With the complex symbol c n = cos 4> n + i sin <fr n , i.e., even values of n, the 
c n 's are drawn from the QPSK constellation (marked by • in FIG. 3) and for odd intervals, they are drawn 
from the tt/4 shifted QPSK constellation (marked by ■) in FIG. 3. The IS-54 document will provide further 
guidance respecting the illustrative modulation scheme described above. 

Fading Channel Model 

20 it proves convenient for purposes of analysis and to facilitate an understanding of the present invention, 
to adopt a standard two ray model for the frequency selective fading channel 30 in FIG. 1. This model is 
shown more completely in FIG. 6. The model is generally representative of a broad range of channels 
encountered in actual practice and should not be interpreted as a limitation on the applicability of the 
present invention. The impulse response of such a two ray channel model is given by 



f(t) = a(t)5(t) + Ab(t)5(tau), (3) 



where a(t) and b(t) are narrow-band Gaussian process, and t is an arbitrary but fixed delay. The parameter 
A is an attenuation factor that determines the strength of the second ray. For illustrative purposes only, the 
30 attenuation factor, A, is set to unity. The narrow-band Gaussian processes are substantially equivalent to 
those that are generated by filtering independent white Gaussian processes. Consistent with results 
observed in actual practice, the fade is assumed to be constant over one symbol. The amplitude of the 
fades a(t) and b(t) are distributed according to normalized Rayleigh distribution function which is given by 

p(x) = 2xe-»\ < 4 > 

For typical channels, such as those encountered in cellular communication systems,, the phase of the 
Rayleigh fading is equally distributed between (-*, tt) and the autocorrelation of each discrete fade process 
40 satisfies 

R n (r) = Jo(2irf fl T) (5) 

where f g is the Doppler frequency given by 

45 

fg = V/X , (6) 

where v is the vehicle speed in meters/s and X is the transmission wavelength in meters, 
so Baseband Channel 

The received signal, after coherent demodulation and receive filtering by demodulator 40 in FIG. 1, is 
given by 



55 



r(t) = £ c n h(t-nT) + n(t) 



(7) 
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where c n = l n + i Q n is the differential modulator output at the n ,h symbol interval. The baseband channel 
impulse response h(t) is given by convolution relationship 

h(t) = g(t) ® f(t) ® q(t) (8) 

5 

where g(t) is the, typically square-root Nyquist, transmit filter, f(t) is the baseband impulse response of the 
transmission medium and q(t) is the baseband impulse response of the receiver filter. The noise, n(t), is 
additive Gaussian noise with power spectral density 

70 N(f) = No |Q(f)| 2 (9) 

where Q(f) is the frequency response of the receiver filter. A representation of the entire baseband 
transmission channel of the system of FIG. 1 is shown in FIG. 7. 

75 DECODING 

The problem of decoding involves use of the received baseband signal r(t) (the output of receiver filter 
740 in FIG. 7 prior to sampling) to find that modulator output sequence c = { c-i , Co, Ci , ... } and hence 
the corresponding modulator input sequence {b k } which minimizes 

20 

J [r(t) - £ c„ h(t-nT)] 2 dt. (10) 

25 

In appropriate cases, a different particular error criterion may, of course, be used. Instead of solving Eq. (10) 
directly, it proves convenient to solve what may be viewed as a numerical approximation to Eq. (10). 

First, the received signal, r(t), is sampled at an integer multiple R of the baud rate. Then, the sampled 
received signal during the i th symbol interval is given by 

30 

n(X) = r[[i + r ]T] , 0 S I i R ■ 1 t (11) 

where, as before, T is the symbol period. 

FIG. 8 shows a circuit arrangement for generating R sequences r k (l), I = 0,1,...,R - 1. In that circuit, the 

35 received signal r(t) appearing on input 800 is advantageously applied first to a bandpass filter 801 
illustratively having bandwidth R/2T to filter any extraneous high frequency components. The filtered signal 
is then sampled at the rate R/T by sampler 802 and distributed to the R additional samplers 803*. The first 
of these additional samplers, 803o, selects the initial (indexed as the zeroth) sample produced by sampler 
802 during each T-second interval, while the next sampler, 803i, selects the second sample (indexed as 

40 sample 1) produced by sampler 802 during each T-second interval. Similarly, each .of the samplers 803 t 
selects the (I - 1)th sample produced by sampler 802 during each T-second interval. This processing 
permits Eq. (11) to be interpreted as characterizing a set of R interleaved sample streams, each sampled at 
the baud rate, 1/T. Similarly, the channel response is defined as 

45 h t (i) = h[[i + £ ]T] . 0 S t 2S R - 1 . (12) 



Then, Eqs. (7), (11) and (12) give 



50 



= £ c i-n h n (€) + n ; (€) 



(13) 



Thus, the overall sampled channel of FIG. 7 can be viewed as R sub-channels, with each sub-channel clock 
55 offset from its neighbor by T/R, and with each sub-channel being driven by a sequence of data symbols 
occurring at the baud rate, 1/T. 

FIG. 9 shows a representation of an overall channel including R sub-channels in accordance with the 
method described above. At each instant, the input to a subchannel is the data symbol c k . The output of 
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subchannel I is r k (l), i =0,1,2,-(R - 1). 

FIG. 10 shows a particularization of the channel of FIG. 9 for the case of two subchannels that is helpful 
in the further description of the present invention. The T-second-spaced impulse response samples for each 
of the two subchannels in FIG. 10 illustratively span three data symbols, i.e., the current symbol and the two 
5 preceding symbols. Thus, for the subchannel corresponding to the first half of a T-second period, the 
sampled impulse response is 

h(0) = {ho(0), hi(0),h 2 (0)}. (14) 

10 The sampled impulse response for the other T-spaced subchannel (having a time offset of T/2 from that 
characterized by Eq. 14) is 

h(1) = {h 0 (1), hi(1),h 2 (1)}. (15) 

ts The two sampled outputs of the illustrative channel during the K th time interval in absence of noise are 
given by 



20 



25 



35 



Sk(0) = E c k _i hi(0), and 
i=0 



2 

S k (D = Z C *-i h id) ' 
i = 0 



(16) 



The problem of decoding then resolves to finding modulator output sequence c - {c_ n c-i, Co, ci 

30 c n ...} such that the overall metric, J, where 

+ ~ s k (0)-r k (0)ll 2 +i|s k (l)-r k (l)|| 2 , . (H) 



is minimized. 

40 Trellis Decoding Algorithm 

Because of the characteristics of typical communications channels noted above, the output from the 
overall composite channel of FIG. 7 (including all subchannels represented in FIGs. 9 and 10), during the 
time interval (kT, kT + T) is determined by a "current" input c k and previous inputs c k = (c k -i c k - M ). 

45 This M-length vector c k is representative of the state of channel inputs contributing to a current channel 
output. In FIG. 10 and Eqs. 14-16, each subchannel output is indicated as being affected by symbols 
transmitted in two intervals prior to the interval corresponding to the "current" symbol, i.e., M = 2. For each 
input state, four transitions can occur, corresponding to the four DQPSK symbols in each symbol 
constellation. Associated with each state transition for the illustrative context of FIG. 10 are two channel 

so signals s k (0) and s k (1) which are given by 

s k (i) = z c k _„h n (i). (18) 

55 n=0 
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Since the transmitted data symbol in each input interval takes on one of 4 possible values, we can describe 
all possible channel states and outputs by a trellis with 4 M states., for each T-second interval, with 4 
branches entering and leaving each state. The data sequence that minimizes Eq. (17) can then be found in 
accordance with one aspect of the present invention using a variant of the well-known Viterbi algorithm. The 
5 decoding of received signals for the illustrative IS-54 system is, of course, subject to the constraint that the 
c k *s in two adjacent intervals are drawn from two separate constellations, with a phase offset of W4 between 
them. 

FIG. 11 shows a complete state transition diagram for the illustrative IS-54 system with two-symbol 
memory. Since M = 2, each state comprises a symbol pair as described, e.g., in S. Benedetto, E. B. BigJieri 
70 and V. Castellani, "Digital Transmission. Theory," Prentice Hall, Englewood Cliffs, 1987, especially chapter 
7. With M = 2 and with four possible symbols, there are. therefore 4 2 = 16 states. 

In particular, FIG. 11 shows the transitions from states associated with the symbol pair c k c k -i at time k 
to that for the symbol pair c k+1 Cj( at time k + 1. In each case the symbols are assigned one of the values 
i =0,1,2, or 3 as a shorthand for the actual values for c i( which are known to take one of 4 values e*°, e i * /2 , 
75 e i Ve J3 * /2 or e j * /4 , e* 3 *' 4 , e i5W4 , e* 7 *' 4 alternately in successive T-second symbol intervals for the illustrative IS- 
54 system. 

The X 1h subchannel output for the illustrative case of two-symbol channel memory during a transition 
from state c k c k _i at time k to state c k +iC k at time k + 1 is correspondingly given by Eq. (17). Each such 
transition has associated with it a cost or error metric of the form shown in Eq. (17). 
20 As is well known in the art, the sequence of symbols corresponding to the path through the trellis 
having the minimum error-related cost or metric is advantageously chosen to be that actually transmitted. 
Difficulties in performing these metric evaluations include complexity arising from the number of paths for 
which metrics must be calculated and the accuracy and currency of the estimates of the channel impulse 
response samples. 



25 
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Channel Adaptation Algorithm 



Most prior equalizers used with time-varying channels, such as mobile radio channels, use estimates of 
sampled channel impulse response coefficients, h, based initially on a known training sequence sent from 
30 the transmitter. These initial channel coefficients are then typically updated in an on-going process using a 
decision-directed adaptation algorithm, such as the normalized LMS algorithm described in the 1989 book 
by Proakis cited above. 

If the decoder decisions are given by c k at time k then, during the k th interval the channel update 
equation for the arrangement depicted in FIGs. 9 and 10 and described above is given by 



h£(*) = hk-i(«) + A- e k (0 (19) 



where h k (Jt) is the l lh T-spaced channel impulse response estimate vector, i.e., h k (l). = (h 0>k (I),hi ik (t)- 

h M ,k(*)) during [kT, (k + 1)T] where h i(k (I) is the i ,h channel coefficient of the 1 th T-spaced channel 

impulse response estimate during [kT,(k + 1)T]. Here, 



Ck = (Cjc, C k _i, C k _ M ) 



where denotes the complex conjugate and t denotes the transpose. The symbol c k is the estimate of the 
transmitted data symbol during the interval [kT,(k + 1)T]. The step size adjustment to the channel param- 
50 eters, A, is chosen to be a small quantity and is illustratively given by 



a= <mTT)F (20 > 



where P is the average power in the transmitted symbol c n . The l 1h sub-channel error e k (l) is given by 
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i=0 

5 

In practice, the Viterbi decoder releases decisions c k with a certain delay D. That is, in making 
decisions about c kl the decoder also takes into account, the contributions of the data symbols up to time (k 
+ D)T. In general, the decoder decisions are reliable when the decoding delay D is large. However, in a 
non-stationary environment such reliability cannot be assured. This is the case because the error e t (i), i>k, 
w for the 1 th sub-channel is evaluated using the channel estimate at time (k - 1)T and, for large D, the channel 
might have changed significantly during the evaluation period. Thus, the metric evaluation for the traditional 
Viterbi algorithm is potentially sub-optimal due to such channel mis-match, resulting in increased decoding 
error probability. 

In accordance with an aspect of the present invention, tentative decisions that are obtained with a 
75 smaller decoding delay than required to make reliable final decisions are advantageously used, for the 
purpose of channel updating. Typical choices of delay for channel updating and decoding have been 
obtained through experiments. 

Improved Equalizer/Decoder 

20 

An equalizer/decoder including an implementation of a modified (hybrid) Viterbi algorithm and enhanced 
channel adaptation algorithm in accordance with aspects of the present invention is shown in functional 
block form in FIG. 12. In the arrangement of FIG. 12, incoming samples arrive on input 910 where they are 
processed by the hybrid trellis decoder 930 in a manner detailed below. The outputs on lead 970 from 
25 decoder 930 are the final decisions, as to what symbols c k were sent from the modulator at the transmitting 
location. 

Also appearing as outputs from decoder 930 are tentative decisions made during the modified Viterbi 
decoding process, which tentative decisions are used not as final decoder outputs, but in forming good 
short term estimates of transmitted symbols to be used for updating the channel coefficients. Thus short- 

30 term decisions appearing on output 980 are processed in estimating element 960 to form channel output 
decisions assuming noiseless transmission. In performing this function element 960 typically uses the finite 
impulse response (FIR) filter of FIG. 5. Thus, rather than using actual source sequence symbols l k and Q k 
used when transmitting into a channel, the filter circuit 960 uses the current tentative decisions appearing on 
output 980 to generate signals on its output 961 of the same kind as are received from the channel on input 

35 910. The qualitative difference between those signals on input 910 and those on the output 961 of filter 960 
is that the latter are free of distortion and noise introduced in the real channel. 

The noiseless estimates of transmitted symbols are compared in comparator 950 with the actual 
received symbol information, which has been delayed by delay unit 920 for a period D' to account for the 
processing delay introduced by decoder 930 and estimator 960. The difference between the actual input 

40 and the noiseless estimate of such input has the nature of an error signal which is then used by channel 
tracking element 940 to adjust the values for the channel coefficients used by decoder 930. In general, the 
data used by the channel estimation and tracking algorithm by element 940, 950 and 960 may be different 
from the final decoder decisions c k . Thus, input to the channel updating process on output 980 of decoder 
930 is denoted by c* k . 

45 

Trellis Algorithm 

The use of an enhanced trellis search algorithm to effect decoding and equalization in accordance with 
the present invention will now be illustrated with reference to FIGs. 12-14. For purposes of this illustration, 

so the significant intersymbol interference will again be assumed to extend to the two symbols prior to a 
currently processed symbol, i.e., M = 2. That is, in addition to the output, c k , of modulator at the transmitter 
for the symbol period corresponding to the "current" period of the received signal, there is a contribution to 
the channel output from the modulator output during the two periods preceding the modulator output for the 
current period. As noted earlier, this degree of channel "memory" is typical of channels encountered in 

55 practice in such contexts as cellular mobile telephone applications. FIG. 10 and the related description given 
above illustrate generally the memory effects for such a channel. 

Thus, the T-spaced subchannel impulse responses for a two-subchannel context can be represented by 



10 
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h(0) = {h 0 (0) f hi(0),.h 2 (0)}and I 
h(1) = {h 0 (1), hi(1),h2(1)}. (22) 

For a given modulator output sequence {c k }, the two T-spaced channel sequences, with a relative offset of 
5 T/2, are then given by 

s k+1 (0) = h 0 (0)c k+1 + hi(0)c k + h 2 (0)c k _i 

s k+1 (1) = h 0 (1)c k+l + hi(1)c k + h 2 (1)c k -i . (23). 

io As noted above, a straightforward application of the Viterbi algorithm in this context would compute the path 
with the lowest cost (or metric) into each state of a 16-state trellis using a dynamic programming procedure. 
For a symbol sequence of even modest length, the computations of the cumulative path metric for the 
range of symbol periods presents computational complexities that may be difficult to implement for some 
applications, such as a mobile celluiar communication station. 

75 In order to reduce such complexity, while retaining a high degree of decoded symbol accuracy, an 
alternative four-state trellis of the type shown in FIG. 14 is defined in accordance with an aspect of the 
present invention where the states are determined only by a single symbol c k . Thus, for the signaling 
alphabet of the typical IS-54 system, at time k + 1 , there are paths entering each of the four possible states 
c k+ i from four predecessor states, c k . 

20 In FIG. 14, the states are identified by the index 0,1,2,3, again a shorthand for the actual symbol values. 
Specifically, 

0 is either e* 0 or e* W4 

1 is either e**' 2 or e* 3wM 

2 is either e ei " or el 5 "' 4 
25 3 is either e 13 *' 2 or e i7 " M . 

The channel output associated with a state transition c k — c k+1 in FIG. 14 is determined from Eqs. (23). It will 
be noted that c k _ 1t which is included in the evaluations of Eqs. (23) is not explicitly shown in the trellis of 
FIG. 14. In this respect, FIG. 14 differs from FIG. 11. In the determinations of Eqs. (23), the state c k -i is 
determined based on the best survivor (predecessor state) leading into state c k for each particular state at 

30 time k. So, for example, while determining the channel output associated with a transition to state 1 at time 
k + 1 from state 2 at time k, the assumed state at time k-1 is that in the path having the best metric leading 
to into state 2 at time k. Thus, when evaluating metrics for paths leading into states at a time k, it proves 
convenient to retain the identity of the state at time k-1 that yields the best metric for each state at time.k. 
So, for the 4-state trellis of FIG. 14, it proves convenient to retain for each state i(i =0,1,2,2) at time k the 

35 identity of the state from retain for each state at time k the identity of the state from time k-1 that is in the 
path leading to state i at time k which path has the best metric. 

It should be recognized that not all states at time k will ultimately be in the path having the best overall 
metric. Likewise, the assumed state at time k-1 leading to a state at time k may not be in the path finally 
selected as having the best overall metric. Nevertheless, for purposes of calculating the channel output with 

40 reduced complexity, the assumptions prove valuable. 

Using these steps, the outputs for all transitions to each state at time k + 1 are determined and the 
branch metrics are calculated according to 

45 J k+1 = |e k+1 (0)| 2 + |e k+1 (l)| 2 

where 



50 



55 



2 

e k+ i(0) = r k+1 (0) - 2 c k+1 -i hi(0) 



i = 0 



and 



e k+ i(l) = r k+1 (l) - £ c k+1 -i hi(l) . (24) 

i=o 



11 
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The total cost (metric) for each of the four paths entering each state at time k + 1 are evaluated and the path 
with the lowest cost is retained for each state at time k + 1 . 

FIG. 13 is a block diagram of functionality for use in decoder 930 in FIG. 12 for computing branch 
metrics in accordance with Eqs. (24). Shown in FIG. 13' are sub-channel units 975- i, i = 0,1,...,(R-1) for 

5 generating the Si(JL) signals resulting from performing the convolution functions of Eqs. (23), based on 
stored estimates of sub-channel coefficients, h, and transmitted symbol values c k , appearing on input 974. 
Received values r(k) appearing on input 973 are sampled by samplers 972-1 at respective multiples of 
. 1/RT, with the result being compared in comparators 976- i with the output S k (i) from respective sub- 
channel units 975- 1. The output of each of the comparators 976- I is an error term that is then squared in 

10 corresponding squarers 977- 1 before being summed in summer 978. The outputs of summer 978 on lead 
979 are the desired branch metric values: 

FIG. 15 is a typical trellis illustrating the reduced complexity of metric computation in accordance with 
the present invention. Thus, in computing the metric into each state at time k + 1 , only four possible states 
are used; these states at time k are identified as states 0,1,2 and 3, as in FIG. 14. The symbol value pairs 

75 for each state are again the alternating symbol values associated with that state for the case of an IS-54 
system. Each branch metric is calculated in accordance with the teachings of FIG. 13, and more specifically 
for R = 2, in Eqs. (24). For each state at time k + 1 , a metric for the branch leading from each state at time k 
is calculated. 

However, in determining the value for c k+1 -i when i = 2 in the summations of Eq. (24), the value is 
20 chosen that yielded the minimum path metric leading into each state at time k. Thus in calculating the 
metric for the path extending from state 2 at time k to state 3 at time k + 1, it is assumed that the 
corresponding symbol for the time k-1 (i.e., c k -i) was that associated with state 0. Likewise, computations 
for other paths extending from state 2 at time k assume that the symbol at time k-1 was that associated with 
state 0. These assumptions are based on the determination that the path leading into state 2 at time k with 
25 the minimum metric is that coming from state 0. 
' " The actual calculations performed which lead to the example results of FIG. 15 include those for all of 

the state transitions of FIG. 14, using Eqs. (24). As noted, the state at time k-1 associated with each state at 
time k (the state pair defining the minimum metric path leading to the state at time k) is conveniently stored 
for subsequent use in the course of computations required by Eqs. (24). The values for channel estimating 
30 parameters are likewise conveniently stored, as represented by element 940 in FIG. 12. In the next section, 
the manner of updating the channel estimates will be treated. 

The simplifications that follow from the reduced-state trellis and the assumptions regarding the prior 
states considerably reduce the complexity of the computations without corresponding sacrifice in the final 
symbol estimation. 

35 

Channel Adaptation Algorithm 

Two major problems associated with the use of conventional channel estimation techniques for rapidly 
changing channels are delay in channel updating and use of unreliable tentative data decisions. The 
40 adaptive channel updating algorithm in accordance with another aspect of the present invention avoids 
these problems. 

In the context of the trellis algorithm described above and illustrated in FIGs. 12-15, and in the absence 
of errors, the correct path is available as the locally best estimate. That is, for each time k + 1 , one of the 
four illustrative states will have the path with minimum cost or metric leading to it. Further, such locally best 

45 estimates are available without delay. Thus,, channel updating without delay advantageously can be 
performed by maintaining one channel estimate for each state. 

This "zero-delay" channel updating also reduces the effect of error propagation. This is observed by 
noting that as long as the correct data sequence candidate is a locally best estimate (although not the 
current globally best), then that state has the correct channel (ideally) while the current globally best state 

50 will have an incorrect channel estimate (ideally). Then, the future metric growth for the incorrect state will be 
larger than that for the correct state since the former has an incorrect channel estimate. Thus the algorithm 
has a tendency to inhibit errors. 

It should be noted that maintaining multiple channel estimates, one for each state, can also be 
incorporated into the conventional adaptive Viterbi algorithm. Such incorporation of one-per-state channel 

55 estimates will yield improvements as compared with conventional Viterbi processing especially at low 
signal-to-noise ratios and when the channel is changing rapidly. Maintaining multiple channel estimates in 
the presence of uncertain initial channel estimates or data decisions is described in U.S. patent application, 
Serial No. 07/542,258 cited above. The use of multiple channel estimates has proven especially successful 

12 
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in the context of blind equalization and will be found to be robust to fades as well. 

With the channel estimate at time k and for state m defined as h kim < (JL), where I £ k - 1 as in Eq. 
(12), the multiple channel updating algorithm proceeds as follows: 
1 . Find the best path into each state at time k. 
5 2. Update the channel estimate at time k for each state m as 

hi. m «> = hl- u (€) + A • e k . m (€) • cj* (25) 

70 

I = 0, 1 

m,i - 0, 1, 2, 3 . 

Here hk-ufl), 1 = 0, 1 are the T-spaced channel estimates at the best predecessor state for state m. The 
quantities e k , m (*)» I = 0, 1 are the corresponding error terms and are available as a part of the metric 
75 calculations performed by the above-described modified Viterbi algorithm. As noted, in connection with the 
reduced complexity trellis algorithm, the c k s used., in evaluating the errors are determined by state m, its 
predecessor state for i. 

Channel Updating with a Leaky Predictor 

20 - 

The error term at time k that is used by the illustrative simplified trellis algorithm described above uses 
the channel estimates that are available at time k - 1. In accordance with another aspect of the present 
invention, a simple predictor can be used to predict the channel parameters at time k, and can then use the 
predicted channel estimates in computing metrics. 
25 For example, if the channel estimate for state i,i = 0, 1, 2, 3 at time k - 1 are h k _ 1(i) then the predicted 
channel at time k for any path evolving from state i is given by 

!»£?«) = a h k _ u (*), € = 0,1. (26) 

30 

Here a is a constant smaller than unity. In applications such as a mobile telephone system, e.g., that 
covered in the IS-54 document, a value of about 0.95 is found to be robust for a wide range of vehicle 
speeds. The leaky predictor is found to be instrumental in lowering the error floor that occurs at high vehicle 
35 speeds. The channel vector 




40 then enters Eq. (25) in place of h k _ 1(t (1). The simple predictor described in this section and defined in Eq. 
(26) should be understood to merely be illustrative; other particular predictors, including those of greater 
complexity known in related arts, may prove useful in particular applications of the present inventive 
teachings. 

45 TYPICAL OPERATION 

This section will describe typical operation of illustrative embodiments of the present invention and 
compare results of such operation with prior equalizer/decoders. 

The delay interval is defined in the IS-54 Document as the difference in usee between the first and 

so second ray, where both rays are of equal magnitude, all in the sense of the two-ray model of Fig. 7. The 
following discussion conveniently refers to the delay interval in terms of the symbol period (T). Thus 1 .25T 
refers to a delay of 1 .25 times the symbol period. The effects of delay intervals varying from zero to more 
than one symbol interval, and of various vehicle speeds, can advantageously be evaluated for the present 
invention as compared to conventional Viterbi decoding. 

55 In some cases, the well-known LMS technique referred to above is utilized for channel tracking in such 
prior equalizers and may also be used for some purposes in connection with the operation of equalizers in 
accordance with the illustrative embodiments of the present invention (e.g., at startup). In using such LMS 
algorithms, a step size of 0.14 provides good results. Decisions from Viterbi decoders are illustratively taken 

13 
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at a depth of 10 symbols into the trellis; other symbol depths may prove advantageous in particular 
circumstances. 

An instantaneous channel estimation is not practical because of the processing required to derive 
channel characteristics. Because of this processing delay, a channel estimate derived is usually that for the 
5 channel as it existed at a time equal to one or more symbol intervals prior to the current symbol interval. At 
slow vehicle speeds, such lag of channel estimates will not present a major problem in systems like the IS- 
54 system, but the effects at higher vehicle speed (or other conditions causing rapid channel changes) can 
be significant. 

If perfect channel estimation is assumed in the prior Viterbi equalizers for purposes of comparison with 
w the equalizer of the present invention, it can be shown that the effect of a processing delay of 5D (i.e., five 
times the symbol period), is relatively slight at a vehicle speed of 20 miles per hour (mph) but that the 
effect increases to a moderate level at 60 mph. Further, if LMS channel tracking is assumed instead of 
perfect channel estimation, and correct decisions are fed back, performance degradation is more pro- 
nounced, especially at higher vehicle speeds, e.g., 60 mph. 
75 In a real operating mode, a decision directed equalizer must use its own decisions for updating the 
channel estimate. The delay that accompanies such updating is typically a compromise between a longer 
delay which allows a more reliable Viterbi evaluation and a shorter delay in updating to account for rapid 
changes in the physical channel. 

For further comparison purposes, the performance of a decision directed Viterbi equalizer using a 
20 standard LMS algorithm for startup and channel tracking can be shown to give its best error performance 
for a processing (updating) delay of 2 to 4 symbols at a vehicle speed of 20 mph. Thus a lower processing 
delay, say 1D, results in a considerable degradation except when there is no fading, i.e., when the fading 
delay* interval is not zero. Likewise, performance for larger processing delay, say 5D, shows relatively 
greater degradation despite the greater decision depth possible with the longer delay. The effect of the 
25 channel mismatch is clear. At 60 mph, a preferred channel updating delay can be shown to be 
approximately 2 symbol intervals (2D). The shorter delay can be seen to be of greater importance for the 
higher vehicle speed with its attendant faster changes in channel characteristics. 

Comparison of the foregoing standard single-channel Viterbi equalizers with the illustrative multiple- 
subchannel equalizer in accordance with one aspect of the present invention shows improved performance 
30 by the latter under a variety of circumstances, especially at higher vehicle speeds, or under other conditions 
where the physical channel is changing rapidly. Further, by using the channel adaptation algorithm of the 
present invention, it is possible to obtain an improved channel estimate that proves especially important 
under conditions of rapid fading. While the advantages to be gained will vary in particular circumstances 
with the number of subchannels used, an illustrative number of four subchannels has proven effective with 
35 only moderate implementation complexity as will be understood from the above teachings. 

Improved performance is also achieved using the above- described leaky predictor feature of the 
present invention in channel tracking. The simple first order prediction approach described above not only 
provides reduced error rates, but also can improve the ability of the equalizer to recover from rapid fades. 
Values for the coefficient alpha in Eq. (26) from 0.90 to 0.97 or more have proven effective in particular 
40 circumstances. While particular ones of these and other values for alpha may prove advantageous under 
individual conditions of received signals, channel characteristics and processing delay, the value of 0.95 
proves a good general purpose selection. 

While operations have been described in terms of time intervals, e.g., T-second intervals, such intervals 
are meant only as relative periods or equivalent processing components. Thus, if data transmission or other 
45 non-real- time transmission is the subject of the decoding and equalization in accordance with the teachings 
of the present invention, then the associated processing can be performed at different rates or over different 
intervals as may suit the convenience or necessities of the context. 

While the above description has been presented, in part, in terms of processing operations character- 
ized by one or more mathematical equations, it should be understood that the actual implementations will, 
so as is well known to those skilled in the art, be realized in terms of either program controlled apparatus, such 
as an AT&T DSP 16A fixed-point signal processor or equivalent special purpose processing 

Claims 

55 1. A method for decoding time varying signals comprising 

receiving time varying signals, r(t), from a communications channel, which signals represent 

sequences of symbols, c k , k = 1,2,3 supplied to said communications channel at a symbol rate of 

11", 
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for the kth period of duration T, ' ■ . 

with R an integer, sampling r(t) at rate R/T to produce a set of R samples of r(t), r k (l), I = 1,2,...,R, 

for each of a set of candidate (M + 1)-symbol sequences, c k _ m , c k _ (m _ 1)f ..., c k _ 1( c k , generating a set 
of R values, s k (I), l - 1,2 R, each representing a partial estimates of an output of said channel, 

forming an error signal reflecting the difference between .each of r k (l) and s k (t), I = 1,2 R, for 

each of said candidate sequences, and 

selecting as a symbol supplied to said channel a symbol in the candidate sequence which yields 
the minimum value for said error signal. 

2. The method of claim 1 wherein r(t) is received from a time-varying multi-path communications channel. 

3. The method of claim 1 wherein said selecting comprises selecting the symbol c k from said candidate 
sequence which yields said minimum value for said error signal. 

4. The method of claim 1 wherein said forming an error signal comprises forming, for each value of I, the 
square of the difference between each of said r k (Jt) and s k (l) and summing said differences. 

5. The method of claim 1 wherein said s k (I) is based on a convolution of said c k sequence with samples 
of channel impulse response estimates. 

6. The method of claim 5, wherein said convolutions are given by 

M 

Sk(i) = Z c k-n h n (i) . 

n = 0 



7. The method of claim 1, wherein said step of generating a set of R values, s k ( I) comprises determining 
each of said partial estimates of said outputs based oh a respective partial estimate of the characteris- 
tics of said channel. 

8. The method of claim 7 comprising the further step of updating said partial estimates of the characteris- 
tics of said channel in response to said error signal. 

9. The method of claim 7 comprising the further step of updating said partial estimates of the characteris- 
tics of said, channel in response to a signal representing the difference between each of said r k (t) and a 
noiseless estimate of the channel output. 

10. The method of claim 9, wherein said noiseless estimate of the channel output is generated in response 
to a tentative decision as to the symbol actually sent. 

11. The method of claim 7 comprising the further step of updating each of said partial estimates of the 
characteristics of said channel in response to a signal representing a prediction based on the current 
estimates of respective ones of said characteristics of said channel. 
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